Color 


Dr. Tushar Sandhan 


EE604: IMAGE PROCESSING sandhan@iitk.ac.in 


Introduction 


= Color of the Universe 


EE604: IMAGE PROCESSING 


Introduction 


= Color of the Universe 


VISIBLE SPECTRUM 


300 400 600 nm 700 1000 


EE604: IMAGE PROCESSING sandhan@iitk.ac.in 


Introduction 


= Color of the Universe Se INFRA 
Ze ka El 
000! f 


O001nm  Inm.L--T 10nm, p 


VISIBLE SPECTRUM 


300 400 600 nm 700 1000 


= Visible light 
(dispersion) 


EE604: IMAGE PROCESSING sandhan@iitk.ac.in 


Spectra of objects 
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Spectra of objects 


Light source spectra Reflectance spectra of surfaces 


A. Ruby Laser B. Gallium Phosphide Crystal 
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Color 


= Human Luminance sensitivity 


ultraviolet rays microwaves 


radio waves 


Relative Sensitivity 
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Color 


= Light spectrum is continuous, 
then why are images RGB? 
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Color 


= Light spectrum is continuous, 
then why are images RGB? 


A Evolutionary cones (6 million) 


= Characterization of cone cells & 
understanding visual process in the eye. 


o Ragnar Granit, Haldan Keffer Hartline and 
George Wald 


o Nobel Prize 1967 
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Color 


Three cone types (o, y, B) correspond roughly to R, G, B. 


= HVS retina display 
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Color 


Three cone types (o, y, B) correspond roughly to R, G, B. 


= HVS retina display 


Relative sensitivity 
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| Wavelength 


population-weighted response 
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u Cones (Long:L, Medium:M, Short:S) & Rods:R 
= S: blue (most sensitive) 


= M, Lon chromosome X (some women are tetrachromatic) 
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Color 


» 


= Cones (Long:L, Medium:M, Short:S) & Rods:R " T MAX 
u S: blue (most sensitive) 


= M, Lon chromosome X (some women are tetrachromatic) 


Normalized absorbance 
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= Reptiles : 5 types of cones 
= Mantis shrimp: 12 types of cones 
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Color 
= What is it? 


> psychophysical: physiological sequence of sensory processing 


> perceptual: cognitive representation of a physical reality 


» Imagination of the illuminated retina! 
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Color 


= Sensing 
Bayer pattern 


Incoming Light 


Filter Layer 


Sensor Array 
Bnmunumuu 
m mu 


Resulting Pattern 
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Color 


= Sensing 
Bayer pattern 


Incoming Light 


Filter Layer 


Sensor Array 


Estimate the color 


Resulting Pattern 


EE604: IMAGE PROCESSING sandhan@iitk.ac.in 


Color 


= Representation 


o for graphics & displays 
* CIE chromaticity diagram 
e Commission Internationale de l'éclairage-1931 
* inks, displays, cameras 
e X - mix of RGB 
e Y- illuminance 


e Z - close to blue 


o for computational analysis 
* color spaces 


* processing the color images 
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Color 


= Representation 


o for graphics & displays o Hunt-Pointer-Estevez matrix 


* CIE chromaticity diagram * cone responses to XYZ mapping 


* LMS: cone responses of human eye 
e Ze>sS 


e Commission Internationale de l'éclairage-1931 
* inks, displays, cameras 

e X- mix of RGB e Y- brightness 
* Y- illuminance * X, Z- chromaticity 


e Z - close to blue 


X 1.91020 —1.11212 0.20191 L 
o for computational analysis Y | = | 0.37095 0.62905 0 M 
* color spaces Z 0 0 1.000 00 5 |upg 


* processing the color images 
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= CIE Chromaticity diagram 
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Color 


= CIE Chromaticity diagram 


o concept of color for computations X 
t = OS 
* brightness (white > grey) X+Y+Z 
* chromaticity (white = grey) u Y 
"IY 
o derived parameters for chromaticity guns NE T 1-z-—y 
X+Y+rZ 
e X, V 
e normalized function of all tristimulus values 
* Tristimulus: a color is represented by its 
trichromatic coefficients X, Y, Z 
Y 
X = —z, 
y 
Y 
Z = —(1- z - y). 
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Color 


= CIE Chromaticity diagram 


o concept of color for computations X 
yes 
* brightness (white > grey) X+Y+Z 
° chromaticity (white = grey) u Y 
ARE ET ET 
o derived parameters for chromaticity e NE T 1-z-—y 
X+Y +Z 
e X, V 
e normalized function of all tristimulus values 
* Tristimulus: a color is represented by its 
trichromatic coefficients X, V, Z 
Y 
X = —z, 
y 
o specifies how human eye will experience Y 
light with a given spectrum Z = Pi - L-1). 
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Color 


= CIE Chromaticity diagram 


o all the colors that human eye 
can see, represented as 
color gamut 
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Color 


= CIE Chromaticity diagram 


o all the colors that human eye 
can see, represented as 
color gamut 


Traffic light specifications 


— CIE 1931 Color 


—— Cur rent ITE Traffic (Red) 


Current ITE Traffic (Amber) 


Current ITE Traffic ( Green) 
—8— Qld ITE Traffic (Green) 
—.— Current ITE(Fortland Orange) 
—— Cur rent ITE(White) 
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Color spaces: RGB cube 


= Normalize to float values (0.0 to 1.0) 
= How many possible colors in computer with 3 bytes? 


= You can manipulate image inside this cube Magenta 
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Color spaces: RGB cube 


= Normalize to float values (0.0 to 1.0) 
= How many possible colors in computer with 3 bytes? 


= You can manipulate image inside this cube Magenta 


. 
. 
. 
+ 
° 
‘ 
. 

i | 


‘Gray scale 


Red Yellow 


EE604: IMAGE PROCESSING 


sandhan@iitk.ac.in 


Color spaces: CMYK 


= Printer vs display 
= CMY = 1 - RGB (vector notation) 
= whatisC+M+Y= 7”? 


= to compensate muddy black, ‘K’ is added : CMYK 
K= 1 - max(r,g,b) 
find out other components? 


= hint: C = (1-r-K)/(1-K) 


PRIMARY AND SECONDARY COLORS 
OF LIGHT AND PIGMENT 
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Color spaces: HSV 


= Hue: 
o dominant wavelength in the mixture of light waves 
o dominant color as perceived by us 


= Saturation: 
o relative purity 
o amount of white light mixed in hue to get a color 


= Value: 


o also called brightness 


Green Yellow 


o achromatic notion of intensity 


Cyan? $ Red 


Blue Magenta 
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Color spaces: HSV 


12075 


= Hue: 


o dominant wavelength in the mixture of light waves 


o dominant color as perceived by us 


= Saturation: 
o relative purity 
o amount of white light mixed in hue to get a color 


= Value: 
o also called brightness 
o achromatic notion of intensity 


4 Red 


Blue Magenta 
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Travelling inter-spaces 


= It's nothing but converting image from one space to another 


T=1(R+G+B) 
S=1--—— min(R,G, B) 


R+G+B 


0  B<G 
f= 
eae B>G 


where 
v[(R-G)+(R-B)| 
(A-Gy +(R-B\(G-B)|"” 


cos@ = 
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Travelling inter-spaces 


u It's nothing but converting image from one space to another 


T=1(R+G+B) 
$=1-2,min(R,G,B) 
0 B<G 
= B>G 
where 
cos = MIR-G)HR-B)) 


(A-Gy «(R- BXG - B)" 


= Online converter 
https://www.rapidtables.com/convert/color/rgb-to-hsv.html 
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Travelling inter-spaces 


= It's nothing but converting image from one space to another 


Ja L(R tz B) RGB to HSV color conversion 
Enter 6 digits hex code or enter red, green and blue color levels (0..255) and press the 
S = l — XE min(R, G; B) Convert button: 
0 B < G Enter RGB hex code (£): FFFFOO 
= or 
360 m 0 B e G Enter red color (R): 255 
Enter green color (G): 255 
where 
R G R B Enter blue color (B): 0 
1 = — 
cos0 = — AKG-G)R-B] — | Convert | Reset. 
| 2 [^ 
(R-G)? «(R- B(G — B) "m" 3 : 
Saturation (S): 100.0 % 
Value (V): 100.0 % 


= O N | | N e CO nve rte r Color preview: — 


https://www.rapidtables.com/convert/color/rgb-to-hsv.htm| ——— 
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Color correction 


= Acquired image might be in different illumination or in shadow 


fl fa. 0 O7f7 
Gi=|0 a, 0jj9 
bl LO 0 alb 
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Color correction 


= Acquired image might be in different illumination or in shadow 


r] fa, 0 0O][T 
Gi=|0 a, 0jj9 
bl LO 0 alb 


= White world assumption: brightest pixel should be white 
o divide by max value 


= Gray world assumption: average value should look like grey 
o m = avg over image! (r*g*b)/3 ] 


o F=rxavg(r)/m 


= Histogram equalization on color channels 
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Color constancy 


= Interpret object surface in terms of albedo or true color, instead of observed intensity 


= Contextual phenomenon 


= e.g. banana appears yellow even in blue light 


EE604: IMAGE PROCESSING 


sandhan@iitk.ac.in 


Color constancy 


= Interpret object surface in terms of albedo or true color, instead of observed intensity 


= Contextual phenomenon 


= e.g. banana appears yellow even in blue light 


EE604: IMAGE PROCESSING 


sandhan@iitk.ac.in 


Color constancy 


= Interpret object surface in terms of albedo or true color, instead of observed intensity 


= Contextual phenomenon 


= e.g. banana appears yellow even in blue light 
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Pseudocolor image processing 


= assign colors to grey values (e.g. via 
intensity slicing) f(x, y) 


Intensity axis 


(White) L — 1 
= Note: different from image colorization 


/ Slicing plane 


(estimate underlying true color for a given grey image) 


(Black) 0 | 
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Pseudocolor image processing 


= assign colors to grey values (e.g. via 
f(x, y) 


intensity slici ng) Intensity axis 
(White) L — 1 


= Note: different from image colorization 


— Slicing plane 


: l; 
(estimate underiving true color for a given grev image) 


(Black) 0 


Red 7. E 
transformation fr, y) 
. Green . 
JC y) - transformation l falx, y) 
b. 


Blue = Rix ty 
=> transformation > pix. y) 


EE604: IMAGE PROCESSING sandhan@iitk.ac.in 


Pseudocolor image processing 


satellite 


Credit: U. Berkeley & NASA 
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Pseudocolor image processing 


satellite X-ray 


Credit: U. Berkeley & NASA 
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Pseudocolor image processing 


satellite X-ray Multi-sensors 


Credit: U. Berkeley & NASA 
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Pseudocolor image processing 


= Transformation functions 


Input X-ray image 


Pseudocolor image processing 


= Transformation functions 


Input X-ray image 
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— Green 
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Blue 

tt LN > Intensity 
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Explosive Garment Background 
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Pseudocolor image processing 


= Transformation functions 


Input X-ray image 


*- 
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— Green 
> Intensity 
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Pseudocolor image processing 


= Transformation functions 


o with different transformation functions 


Credit: K. Dmitruk et al. 
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Pseudocolor image processing 


= Transformation functions 


o with different transformation functions 


Credit: K. Dmitruk et al. 
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Conclusion 


- Color fundamentals 


- Color spaces 
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Light sources 


= Spectra to retina sensing 


Color 
" Cones 
= Color spaces 
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Light sources 


= Spectra to retina sensing 


Color 
" Cones 
= Color spaces 


= Pseudocolor images 


Conclusion 


- Color fundamentals TEN | 
Blurring the pseudocolors in 

- Color spaces 

j friendships, reduces the 


relational spaces & life becomes 


Colorful” 


-TS 
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